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ABSTRACT 

In 1993, Bolivia was selected as a site to pilot an 
interactive radio instruction (IRI) project that would provide 
practical support to adult caregivers and children around early 
childhood development. Through linkages with health and education 
networks, PIDI (Programa Integral de Desarrollo Infantil) provided 
young children under the age of six food with health care and the 
attention of two community caregivers. The audio series, "Jugando en 
el Pidi," was created to reach a rapidly growing number of 
caregivers . This report documents the development and appl icat ion of 
this IRI for early child development through conversations with 
caregivers, parents, and child development specialists. It presents 
the quantitative and qualitative evaluation results and unexpected 
information learned through the project. The series targeted young 
children and caregivers, and invited them to participate in 
activities which are age appropriate to the children. The key vehicle 
for learning, enhanced chi Id-caregiver interaction in the PIDI, 
became the focus and goal of the series. For the children, the 
programs provided a time when they could participate in an 
entertaining and consistent sequence of cognitive, physical, 
social-emotional, and communication activities facilitated 
simultaneously by the caregiver and IRI characters. For the caregiver 
and the PIDI system, the programs provided an opportunity to learn 
child development through practice. It made principles of child 
development that are difficult to diges^. on a theoretical level 
practical, available, and easy to understand. The pilot package of 
"Jugando en el Pidi" includes 20- to 25-minute audiocassettes , three 
large color posters, and an illustrated guidebook which includes 
suggest ions for post -radio act ivit ies • (MAS) 
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Overview 

Learning begins at birth. Before the age of five, a child's brain has 
grown to 90% of its adult weight and much of the way the child 
envisions and interacts with the world has been shaped. During these 
crucial early years, it is important to provide the child with nutritious 
food, physical and mental stimulation and a safe place to explore his 
or her social and emotional environment. In these years, problem 
solving skills, attitudes towards the self and others, and the 
foundations for peace, conflict resolution, and school success are 
formed. As these years pass, the experiences of early childhood 
quickly become the capacity and the ability of the adults of the future. 

While the importance of early childhood is not surprising or new, 
ha\ing the structures and the capacity to provdde a supportive early 
en\ironjnent can be very difficult for parents and community members 
given constraints of poverty, the need to work, poor literacy skills, 
time, large families c.nd little knowledge of the kinds of experiences 
which can make the most difference to young children. In 1993, the 
IxamTech project sought a site to pilot an interactive radio instruction 
(IRI) project wliich would provide practical suppc:)rt to adult 
caregivers and cluldren aroimd early child devek)pment. The success 
of IRI in teacliing and supporting other subject matter around the 
world — ^both in formal and nonformal settings — strongly suggested 
that with creativity, patience and a lot of fomiatix'e evaluation, a model 
could be de\'eloped wliich would inspire active leaning and teach 
skills \n a supp(.)rtive and useful manner. 
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With encouragement from Jim Hoxeng and Frank Method from the 
Office of Education at AID, LeamTech looked at programs being 
developed in Bolivia, a country where LeamTech had also 
experienced a great deal of success with Radio Math and was piloting 
Radio Health programs using a child-to-child methodology. 

Bolivia: The First Pilot Site 

In Bolivia, the importance of early child development was becoming 
increasingly recognized. The Government of BoHvia and ONAMFA 
(National C)rganization for Children, Women and the Fanrdly) had been 
actively setting up integrated child development sites in peri-urban 
areas called pidLs with funds from a World Bank loan. Tluough 
lii^kages with other health and education networks, these home-based 
programs were providing young children under the age of six food 
v\'ith health care and the attention of two madre educadoras or 
conwiunity caregivers. Based on a model of integrated early child 
development programs also piloted in Colombia, the Programa 
Integral de Desarrollo hifantil (PIDI) project and each individual pidi 
progTcim gave children the opportunity for a healthy and productive 
start. (PIDI ii^ uppercase letters indicates the nan^e of the overall 
project; pidi ii^ lowercase letters is one of the individual home-based 
child development settings) 

The Role of Interactive Radio Instruction 

The PIDI project's strong integrated approach to early child 
development advocated care and support for the total development 
of the child. But while the health and nutrition components were 
straightforward, the education and parent involvement components 
proved to be more difficult. An extensive audience profile was 
conducted. While the situation was ripe for a positive early child 
development experience, the caregivers did not know what to do. Yet 
despite low literacy skills, little experience learning from the formal 
media or books, and little concrete knowledge of child development 
practice, the caregivers wanted to learn and be professional in their 
capacity as education and care providers. But they felt that the 
knowledge vvas beyond their reach. 

The ONAMFA staff alsc^ recognized that they needed tools not based 
on reading skills and which could help them reach a large and often 
remote audience. The PIDI system was growing so rapidly that the 
ONAMFA staff was finding it impossible to provide regular face-to- 
face instruction for the growing number of caregivers. 
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fligando en el Pidi 

In March 1993, ONAMFA and the LeamTech project agreed to 
experiment with ways to engage young children in active play, and to 
train caregivers and stimulate early learning activities through IRI 
methodology. The following year, an IRI model was created in Bolivia 
which catered to the specific educational needs of the women 
caregivers with poor literacy skills and minimal training and young 
children in the poor peri-urban areas served by ONAMFA. 



Tlie programs 
provide the 
caregiver the 
opportunity 
to learn child 
development 
through 
practice. 



The resulting audio series Jui^amio cn cl Pidi targets two audiences at 
once, young cliildren and caregivers, and iinntes them to participate in 
acti\ities w^hich are age appropriate to the children. Tl^e key vehicle 
for learning, enhanced child-caregiver interaction in the pidi, quickly 
becomes the focus and goal of the series. As each program is aired 
and the caregivers and children actively participate, a character, Tia 
Clara, pc^ints out the significance of the aclixitios and how they can be 
adapted after the program is over. For the children, the programs 
provide a time when they can participate in an entertaining and 
consistent sequence of cognitive, physical, social-emotional and 
C(mi.munication activities facilitated simultanec^usly by the caregiver 
and the \\U characters. For the caregi\'er and the PIDI system, the 
pn^gi'ams prcndde the oppc^rtunity to lean^ child development tltrough 
practice. It makcN prii^cipk^ child development that are dit'fiailt to 
digest on a tlu\)relical level, pnictical, a\'ailable and easy to 
understand. 
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For the program designers and the participants in the pilot pidis, 
using IRI for early child development was new and exciting. For 
twenty minutes at a time, children and caregivers entered the world of 
El Lx)ro Ito and participated in creative games, stories, role plays, and 
activities. They were asked to form lines and circles, divide into 
groups, help each other and express their opinions. They were asked 
to use their senses and imaginations to test their environment, solve 
problems and explore their abilities. As the IRI program set up each 
activity, it not only modeled positive interactions and activities, but 
described to the caregiver in plain language how she could use the 
same or similar early child development group management 
techniques during the rest of her day. These techniques ranged from 
child-tCHThild metiiodology to using local enviroiunental resources to 
asking open ended questions in order to solicit the cliildren's 
opinions, perceptions and feelings. 

The four main IRI series characters include Katy, a little girl about the 
age of the listeners; Tia Clara, a caregiver slightly more experienced 
than those listening; Don Pancho, a wise older man; and the wacky 
and mischievous parrot, El Loro Ito. Every program follows the same 
consistent format. After Circle Time, Tia Clara and Katy talk and 
model activities on the air. The children and caregivers join in. Tliey 
do active activities, listen to a story told by Don Pancho, and do more 
activities. They answer questions and touch, lift, jump, sing and 
compare objects. Tia Clara tells the caregivers the tricks of the trade 
and Katy giggles and laughs as her parrot does funny things. The 
rhvthm and content of the program generally reflects the attention 
span of the three and four year olds. 

Like other IRI programs, the world of jui^mhio ot cl Pidi is culturally 
similar to the peri-urban areas where the pidi programs exist. 
Activities rely on available resources such as stones, trees and other 
children. Because they are all written and tested with children and 
caregivers in Bolivia, the radio characters, music and culture and the 
hands-on interactive style make the programs comfortable and 
nonintimidating. 

Like most other IRI prc^grams, ju^muio ni cl Pidi has supporting 
materials for caregivers to use. The pilot package includes twenty 20 
to 25 minute audio-cassettes, three large color posters and an 
illustrated guidebook which includes suggestions for post-radic) 
activities and has blank pages in the back for the caregivers to add 
and exchange ideas. Although the audio segment was designed to be 
autoncMncuis and learning does not depend on the use of the print 
materials, they enrich the total package and help the caregivers match 
activities to the ONAMFA training plan. 

9 
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Wnnj It Works 

Summative and formative evaluations show that the programs are 
effective in several ways. First, through the interactive radio 
instruction methodology, the caregivers and children are learning 
how to interact and set up stimulating environments for learning and 
growth. Second, they are learning that good early child development 
is not just about reading and counting, but is about learning how to 
become a well-balanced person who can make sense of and feel 
confident in what will sometimes be a confusing world. And 
caregivers are learning that they do not need to be highly literate to 
understand good early child development. 

The success of ]iij^audo eu cl Pidi is also attributable to the working 
style of the design team. From the beg'-nning all members of the team 
went out to the pidis to observe interactions between children and 
caregivers and ask for feedback. ON AMFA staff donated hours of its 
time each week to ensure that the programs were fitting in with their 
training plan and were teaching the kinds of information they found 
to be necessary. OiKe a week the evaluation specialist, the 
scriptwriter, and two early child development advisors — one an 
ONAMFA staffperson — met to review each script in detail and share 
suggestions. This process was lengthier, perhaps, than a less 
participatory process, but the resulting scripts were far superior. 

The participating caregivers contributed significantly to the process 
because they saw it as beneficial to the children in their pidis and to 
their own professional growth. Specifically, they learned: 

To \'alue the games and give them the importance they haw 
during work with children. 

❖ To promote acti\'c learning among the children through 
simple and devolopmentally diverse acti\'ities. 

To feel like professionals and not simply babysitters; that is, 
to re-evaluate their own work as women contributing to the 
development (>f tlie community. 

Finally, the program*^ are effective tools because they were tested, 
reti^tal and relislt\1. VorW carogi\'ers and 285 children listened to the 
tapes, used the posters and sometimcN used the guidebcx)ks o\'er six 
n^ontlis. I\x\1back was solicital from caregi\'ei*s, parents, regional 

iO 
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ONAMFA teams, the national ONAMFA team, and external 
evaluators. Within the design team, we brainstormed, we assessed, 
we complained and we negotiated. When we had to, we threw away 
our adult ideas of what interests children and went back to the pidis 
to observe. 

Growth: Pilots ami Studies in South Ajrica 

Today the pilot can be expanded to reach pidis all over Bolivia. 
Caregivers can be given the responsibility and professional rewards of 
being Jui^mido cn d Pidi trainers for other caregivers and parents. Katj' 
and El Loro Itocan find new adventures and children, and caregivers h\ 
Boli\ia can continixe to use the programs to learn. 

Currently, other countries are also becoming interested in IRI to teach 
early child development and engage children. The Association for 
Training and Resources in Early Education (TREE), an NGO based in 
Durban, South Africa, will soon be piloting a version of jugando en el 
Pidi complete with Zulu stories and characters in the Kwazulu/Natal 
region of South Africa in 1995. These programs will be homegrown, 
but will be based on some of the strengths of the Bolivian project: a 
consistent and proven format, well-de\'eloped characters ax\d a simple 
and direct master plan. 

For all intents and purposes, this case slxidy begins here. This is the 
story of jugaudo cu el Pidi. It documents the development and 
application of IRI for early child development through conversations 
with caregivers, parents and early child development specialists. It 
presents the quantitative and qualitative evaluation results and 
unexpected information we learned when wo were not trying. 

The case study will also introduce some of the people who made 
jKgnudo cn el Pidi possible: Dona Pancha and her daughters who 
tested the programs for the first time; the women of Tarija who decided 
they could use the programs to foster parent in\'oIvement in their 
communities; staff from ONAMFA who contributed their time and 
efforts to ensure that the programs were consistent with the rest of 
their system and would contribute to a better whole. 
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Tarija: Feedback from the Field 

Tarija. 6 p.m. June 14, 1994. Women hurry to arrive at the informal 
ft)cus group meetii^g on time. During the six montl^ of piloting the IRJ 
program ju^audo en cl Pidi, these twenty women and iheir eighteen 
counterparts in El Alto have been asked to give feedback to the 
program observers. During the process, they offered suggestions 
^vhich changed the structure of the programs entirely and gave the 
program designers ideas about h )w to adapt the format and style to 
the environment and the caregivers and children who would use 
them. 

But todav those caregivers were called by the ONAMFA-Tarija 
regional office to report their experiences and opinions to a wider 
audience. In the colloquial and slow language typical of the region 
they live in, thev speak freelv and articulately about a topic they kjunv 
well 

"ll }ias ^ivcn ii<> a confidence ivc did not Jmvc before; it ha^ i^iven 
11^ i^elf-cstcefu," one of the caregivers says, referring to the 
contribution of the program to her work in a local pidi. 

"/ ((t7s s/a/(T, / coiddn V plai/ icitJi the children !V/Y// the yrof^nvn, 
the >lnfne>^ }ia> di^iypemed and I have cstabli:^lied ;fOixi 



'With the 
program, the 
shymss has 
disappeared 
and I have 
established 
good 

communication 
zvith the 
chihirenJ' 
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"Before I did not know how to teach the children, I did }:ot know 
how to explain thinf^s to thenu.. now, with the radio and the 
poster, I know because I have done it,.." 

"When there was uo radio, I read stories but I did not know what 
to do with them..." 

The majority of the women from Tarija who piloted Jugando en el Pidi 
are Quechua women who migrated from mining towns in the cold 
northern region of Potosi. When the mines were closed down and 
their husbands lost their jobs, they travelled to the warm valley region 
of Tarija along with their families with the hope of finding a job and a 
better life. 

"Ofie listens and has ideas for douifi things ... or sometimes one 
ifwents other games," adds one caregiver. 

"The children did not know how to talk among themselves; now 
the]! know," one caregiver suggests when asked what the 
children learned. 

"J used to get 
bored with the 
children^ and 
they used to 
get bored with 
me;nozv we 
know what to 
do../' 

Tlu'se twenty wonu^n who speak so higWy of the jiigando en cl Pidi 
program now alsc^ made the evaluation prcKcss challenging. Not only 
did they provide real feedback c^n the early programs and say that they 
needed to know more directly why each actiWty was included, but 
they alst) did not always follow the pilot rules. Wlien the evaluators 
told them they were testing learning over the radio in Tarija and that 
they could only listen to the programs once before they returned them, 
they retaptxi the programs and the songs at home, passed them out to 
other pidLs not in tlie experin^^ntal group, and copied them to use in 
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parent meetings. VVTiile the formal data about leaniii^g from radio was 
lost, the programs designers learned much more significant 
information about the caregivers' ingenuity and the value of the 
progranis to the community. 

"Parents have come to the meeting luui have listoied to the 
proi^ratn at the pidi; they left con^ratulati)!^ us, they were very 
happy to listen and watch the programs" pointed out a proud 
caregiver. 

While all pidis are community-based, it is still difficult to involve 
parents and to support their learning. According to the regional 
ONAMFA office, the ten pidis involved in the pilot in Tarija received 
more prestige in their communities and among parents than those 
which did not follow the program. 

At the end of this final feedback session, it is clear that these women 
believe the program was useful and had a great impact upon them 
and the children. They take pride in the fact that the programs are 
changed due to their initial feedback. They are satisfied and they 
want to know when the next program is coming out. 

"It helpjs us to teach the children hj playing. For thcni it is easier 
to learn by playing" adds somebody laughing. 

Another says: 

"/ used to get bored zoith the children, and they used to get bored 
with me; noio we knoxo zvhat to do.." 

Dona Pancha: 

The Beginning of a Long Process of Learning and 
Feedback 

Six months previously and 700 kilometers away, in the Altiplano city 
of El Alto, at 4000 meters above sea level, a woman. Dona Pancha, 
tests each program for the first time. After this first cycle of formative 
evaluation, the programs are rewritten, retaped and retested again in 
the other 19 experimental pidis in Tarija and El Alto. The final IRI 
programs, posters and guidebook are produced only after these three 
cvcles of formative evaluation. 

Like many of the other residents of El Alto, Dc^na Pancha is a Aymara 
Indian women who arrived from the countryside three decades ago. 
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She Ls thirty-six years old and has had three years of formal education. 
TcKlay she lives in a city which has emerged without urban planning 
imd vvliich, with its 4()5,00C1 tnl^abitants, is the tliird most populous 
city in felivia; the per capita iiKome is US$400. 

She is one of 155 women in El Alto who is paid a small stipend to mn 
a local pidi. Hidden in their El Alto homes, she and other caregivers 
care for 15 children between birth and six years of age from Monday to 
Friday for eight hours or more. Chosen by ONAMFA criteria, each 
child who enters a pidi is either undernourished or at a high level of 
nutritional risk, from a home with workii^g parents with nobody to care 
for them (abandonment risk), or from a home with only one 
parent or adult relative. Dona Pancha purdiases supplit^, ccx)ks for 
the cliildren, and tries to keep them healthy and happy. It is a 
denianding job and she has little time for anythuig else. 

All children attending Dona Pancha's pidi live in the neighborhood. 
Their parents are carpenters, construction workers, infom^al workers 
or nv^ids. Before the pidis were opened, if they wanted to work, some 
were forced to leave their cliildren unattended. Others took their small 
children into the streets of Li Paz to sell small candies or commodities. 
Tlie children would sit close to their mothers all day and wait. 

Dona Pancha's pidi, as do those in Tarija, addresses the need for 
economic viability and childcare in the following way: 

❖ Urban-marginal women work as caregivers of children within 
their own con^Tiiinit)^ Tlu^y eani nioney and leant niicrcv 
enterprise nianagement skills. 

❖ Working parents of children attending the pidi are assured 
that their children are taken care of w^hile they are not at 
home. 

But after an average of two days of training in child development and 
some technical assistance, Pancha and the other El Alto and Tarija 
caregivers still do not feel confident in their new jobs. They tnist their 
own experiences as mothers to take care of the children, but they need 
organizational techniques, ways to use child-to-child methods, tricks 
to calm the children down and keep them happy, and ideas for 
activities which can turn rocks, sticks and garbage into educational 
resources and opportunities for learning. Because Dona Pancha 
believed lu^^mido eii el Pidi could help, she volunteered to be the first 
experimental pidi. 
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Doiia Pancha's Contribution: The First Stage of 
Fonuative Ezmluation 

The first responses of the children and of the caregivers in jiigmuio en el 
Pidi were observed at Panch^ 's house. In this pidi, errors, forgotten 
instructions aiid pauses for interaction wWch were too short were 
detected. 

For Pancha, the program means a lot. "My teacher, it is" says this 
indigenous woman who speaks constructing her Spanish sentences 
placing the verb at the end, as so many Aymara women do. 

"It haii ifiven me ideas of what to do. Noxo I ktioic wJmt I can teach. Before 
I could not iniaifirie it" she says as she positions the cassette in the tape 
recorder. Her older daughters push aside the tables and chairs of the 
pidi so there is enough space for Circle Time. The children become 
excited when they hear the first notes of the music. They hold hands 
quickly and begin to sing. 

The children wait impatiently for instructions. They know the four 
characters of the series. The likability and acceptance level of the four 
characters in ju^]a}ido en el Pidi was first tested in this room. 

Many important design elements were discovered here. For example, 
it was here that the program designers discovered that the stories in 
the first programs were too long and complicated for the children. 
While the adults loved the morals and the storylines, the children 
became restless. It was hard for the adults to let them go. 




^ the Circle 



1 become 



excited when 
they hear the 
first notes of 



The children 



Time music. 
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The twenty five minutes pass quickly. Dona Pancha and her older 
daughter participate in all the activities. The observers are pleased. 
The children participated during Circle Time. The older children 
guided younger partners and danced when they heard the music and 
stopped when the music stopped. They all fonned a line and 
pretended they w^ere a human train, and during the story, the children 
imagined tliemselves flying as birds and aawling like cats...all just 
before the story turned into another game and they were learning in a 
new way. 

When the program finishes, Pancha is ready for the post-radio 
activities. She takes out a poster. As she sits down with the children, 
she asks each child about the poster. The poster reinforces 
the concepts learned during the program and the cliildren are eager and 
want to touch it... 

After a few minutes, Pancha puts the poster away. The children are 
tired. The almost thirtv-five minutes has required a lot of attention, 
activity and concentration for three, four and five year olds. Now the 
children prepare for lunch. Tomorrow they will listen to another 
cassette. 

An easy to use guidebook full of illustrations will be useful to Pancha 
in the afternoon or during the rest of the week for creating new 
activities and understanding how those she has done fit into her pidi 
plan. The activities in the cassette are explained in the guidebook in 
the categories of child development. Other related activities are also 
suggested. 

From Pancha's perspective, jugando en el Pidi helped her work with 
the children thuuigh simple but very significant games in terms of the 
child's development. She learned that materials in her own 
surroun.dings and in her own pidi could be used and that children 
learn in many ways. She learned the power of her own involvement 
and how much she could offer the children. And importantly, she 
leanxxi orgai^izatioi^ techniques for the better management of her pidi. 

The opinioi^s of the women in Tarija and Dona Pancha are consistent. 

"Tlie pro^ruf}! s<n/^, the ehihlrc}! ^Inndd be allowed to expre^^ 
their oivn upinioni^. It //f?s helped them to learn, to listen and lo 
mider^ttvid, mid it //t/s tiui<^ht nie to know what to do ivith the 
<torie^..." 

"It //(/s helped }}te to or^^niiize, i^iiide and prepare the \^ronp." 



ERLC 
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The Second Cycle of Formative Evaluation: Looking for 
Active Learning and Measurable Objectives 

After a program was tested in Dona Pancha's pidi and was rewritten 
and retaped accordingly, it was retested in the nineteen experimental 
pidis in El Alto and La Paz. Observers from El Programa de 
Educacion por Radio (PER) and ONAMFA filled out observation 
forms which documented the technical quality of the audio tape, the 
le\'el of child-caregiver interactions, the level of commurdcition among 
children and with the caregivers and the effectiveness of the acti\dties. 
Each observer loc^ked for completion of measurable objectives spellud 
out in the master plan to judge if the programs were fulfilling their 
purpose and the children and caregiver were able to actively 
participate and learn. 



'It [the 
program] has 
helped me to 
organize^ 
guide and 
prepare the 
group/' 

The second cycle of formative evaluation was important as pidis 
differed drastically across the country in many ways: space, the 
poverty level of the family, the knowledge and creativity of the 
caregiver, the ages and health of the children and the general 
resources available. Some pidis had very little space indoors and 
physical constraints made some activities more difficTjlt, for example. 
Other pidis had a lot of space and the caregivers needed to make sure 
that younger children die! not creep away when the show was 
broadcast. Techniques and options were offered in the programs to 
neutralize some of these differences. 

The fomiative evaluation aho taught the c^bscn-ers and program 
designers wliat the cliildrcn and cnregi\'urs were capable of in twenty- 
five minutes and what activities were better set-up and postponed 
until after the program. For example, for acti\ities wlierc slow and 
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deliberate fine motor skilLs were practiced or children needed to take 
turns to explore a concept, it was difficult to predict how many 
children would be in a pidi and how long each child would need to go 
through an exercise. At the same time, while taking turns was 
demonstrated on a few occasions, activities which were very time 
consuming were generally not a good use of the program time. 

For the child development specialists, the formative evaluation was 
very important. For Jill McFarren A\'iles from ON AMFA, 

"the pvv^nmis improved in relation to duration, /7cf/i'/7/Vs, 
materials, etc., in viezo of the results obtained during formative 
ez^a I nation. Having results for all the programs, zee beliei'e that 
jugaudo en el Pidi as n whoh' is appropriate for the children a)ui 
the caregivers in tlie project." 

According to Frida LecSn, also an early child de\'elopment 
specialist and an observer during the forma ti\'e evaluation, 
"ItJie earegii'crs] learned nezv tecJmiques of hitelleetual 
dtvelopnient , of language, motor a) id Iwiy and musical 
exjvessio}!. Tluy acquired a niore actiiv attitude and permaiienlly 
huuwated the educutional proces*^ with the children." 

Finally, the formati\'e ewiluation was important for testing the use of 
the posters and print instructions (which later became the guidebook). 
Originally, for example, Jugando eu el Pidi used one poster per program 
with wTitten ti\stmctions on the back. The caregiver would hold the 
poster in front of her after the audio portion and follow the follow-up 
ij^tructions on the back. Observx^rs found tliis to be a distracting use 
of the visual aids as the caregivers simply read the questions on the 
back and did not take over the acti\ity on their own. Other caregi\'ers 
seemed particularly intimidated by the intrcxiuction of written 
material. Because the posters and guide were i ie\'er meant to be a 
significant part of the package, the team decided to print only three 
comprehensive posters and put aU written materials in a vLsuaUy 
oriented guideb<.X)k which would reinforce the messages gi\'en cn-er 
the radio, and which would prcnide additional infcmiaticni fc^- more 
adwnnced caregivers. 

Jill McFarren A\qles also added, "7b have included posters 
a}id giddehxiks as reinforeemeut hi the programs nihnved the 
completion ofn varieti/ ofstinudus for an integral leanihig. Wf 
obsewed that the ix^sters rehiforeed the visual sense... Iiouwer the 
central ttx>l hi learning mis the audio progiwn/' 
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Interactivity: Insights from an External Evaliiator 

As the new IRI model evolved and the children and caregix'ers 
interacted more and found the format and directions more useful, the 
]u^ando en el Pidi team went outside Bolivia to test the series and sc^licit 
n^ore feedback. Early child development specialist, Judith E\^ans, read 
scripts, travelled to Boli\na aj^d observed programs in both El Alto and 
Tarija. As part of "an ex^aluation of a program in development/' she 
offered us these insights on interacti\ity, liiifanilo en el Pidi md early 
child development: 

''One of the effective kcijs for early childhaxi programs /s the miif hi which 
careifivei'i^ interact with the children. The role of tJie ciire\^iver /s to s/z/^wf 
the children'^ deivlopnient tlirough the creation of an atmosphere in which 
the children feel safe; to provide nintehnls the child caii explore; to facilitate 
the learnin;^ of new concepts and ^^ive them the opportunity to apply what 
the}/ learned; to make them have exjkriences that sti)nulate their lan^na^^e 
and communication skills and help them nourish their de-oelopment of their 
self-estean. To achieve all this, the care\^iver has to understand tlie 
deivlopment of the child and the m-eds of children at differott ages. She has 
to deivlop strategies tluit supyivrt the child's thought aiid reasivwi^ skill 
development, and she has to be able to ^ive the needed support tluit will help 
children to }rrceive theinsi'hx's as successfid learners. This is not easy. 



The importance of adult a}ui child hiteractioi} aiid the strate^^ies to ntake it 
happen successfully are part of the effective caregiver trai)ihig programs. 
Nevertheless, during traiiihi^ there are frw opportunities to apply the 
principles of adult and cliild interaction that are being prescfited. It is 0}ily 



Tlie formative 
evaluation 
was important 
for testing the 
activities^ 
posters and 
print 
instructions. 
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wlwn tfw caregiver is in the classroom tliat slie is able to act tlw loay she lias 
been taiij^ht to act. Wink she can be fortumte receiving feedback to Iter 
cfficienai, this /«? not done often enough to guarantee that the principles aiid 
tlw practice arc completely integrated. 

In jugando en el Pidi, the caregiver is introduced to the principles as ivell as 
to the practice of adult-child interaction loithin the same context. Vie adult- 
child interactioi nourisht^s itself through the program. In this way, 
interactive radio, as it is done in jugando oi el Pidi, is a)i ini]iortant tool since 
it provides the caregivers zvith the tlieonf and iviih tlw practice of an effective 
adul t -child h i teractio) i . " 

Evidence of the Quantitative Kind 

In order to study the overall impact of fugando en el Pidi on the 
caregivers and children, a summative evaluation was also planned. 
The following research components were included: 

Experimental group during and after the pilot. Baseline and post pilot 
data were collected in the nineteen experimental pidis which assessed 
the level of verbal communication, physically apparent activity, 
positive affect and engagement, and skill level in performing the tasks 
required in the three and four vear olds in the pidis before and after 
the pilot project. 

Fxperimental group wrsus control. Comparison data were collected 
in six control pidis in El Alto. The same data were collected for 
caregivers in the control groups. 

F:\perimenlal group later in the dav: children and caregi\'ers. 
LearnToch wanted to study whether the levels of interaction and 
active learning and communication occurring during the airing of 
jugando 01 cl Pidi would occur later in the day when the programs 
were not being aired. The same summative evaluation observations 
forms that were used during the programs were used later in the day. 
Levels of interactivity, communication, affect and skill were seen to 
roflecl how well the caregiver was able to transfer the skills to the rest 
of her day. 

Ivuiii^ vs. Cassette: Tarija wrsus El Alto. LeamTech also wanted to 
study what media would be more effective, radio or cassette. The 
differences in the media were simulated by only allowing the pidis in 
Tarija the opportunity to use each program once while the El Alto 
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pidis could use them as many times as they wished. As discussed, the 
data were thrown out, but it is still an important issue, 

Surx ev to measure attitudes o( caregixers. A questionnaire was also 
given to caregivers before and after the experiment which assessed 
attitudes about how children learn. 

The following graphs show the data that were achie\^ed. 

Comparison of PosttestResu!ts:£ducatorsin 
Control and Experimental Groups 




General Knowledge Test: Experimental 
GroupEducators 



3 

c 
'o 
o. 



10 

9 

8 

7 

6 

5 . 

4 

3 

2 

1 

0 




B Alto 



Tarija 



Average 



22 



♦ Active Lciinwi^. Early ChildJiooii Development and Interactive Riuiio Instruction 



Comparison of Results: Children in Control and Experimental 

Groups 




Enjoy- 
ment 



Experimental 
Control 



W}0\OT . , 

,, Verbal ^. 
Skills ^, .„ Attention 
Skills 



The strength of the formative evaluation influenced the quality of the 
summative evaluation. Because the format and level of activity in the 
programs changed so dramatically during the process due to the 
obser\'ations and feedback in the pidis, the first few programs were 
not characteristic of the final Jui^aiuio cn el Pidi format. However, even 
though all experimental pidis did not use the final reviscxi version, the 
changes in the pidis were significant. 

Bciiig our ozv}i Watcltdogs: Creating a Rigid 
Structure 



The design team for lii^^ando en cl Pidi was creative and changed the 
format and structure of interactivity within the programs in 
ccx^rdinalion with the formative evaluation, but this should not be 
misleading. The process was rigidly structured from within and 
guided by several principles: it had to be compatible with the needs of 
ON AMFA, it had to be sound in terms of early child development, and 
it had to bc^ replicable, ie., the pn^granxs had to be guidetd by a seasible 
and explicit system of measurable objectiws otherwise kncnvai as the 
master plan. 
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Compatibilitif zvith ONAMFA's Traiuin^ Plan 

In order to make ''jugaudo cu el Pidi" useful over the long run, the 
design team took great care to use the same temiinology and objectives 
that were used in the ONAMFA/PIDl training system. The inclusion 
of ONAMFA staff in all development stages was essential. The 
guiding document, the master plan, was written with the PIDl staff in 
weekly meetings. Each member of the team read each script to make 
sure there were no inconsistencies and observed the programs being 
tested in the one of the 19 experimental pidis. 

This consistency and collaboration was important for several reasons. 
If the infomiation taught on the program used different temiinology to 
mean the same concepts it would only serve to confuse the caregivers 
and everyone else. Similarly, if contradictory messages were used, 
confusion every^vhere would prevail and the programs would 
immediately lose their value. 

According to Judith Evans, a specialist in child development and an 
evaluator of the scripts and the guidebook, the fact that 

"u member of ONAMFA of the natioual PlDI team nv7s involved 
in the development of the programs from the beifinuhi;^ was 
extremeh/ useful in terms of assuring the achievement of 
objeetives, methods mid eiirricuhnn of the PlDl prograiu/' 

She goes on to smj, "the PIDl project child dmlopment 
perspective is reflected and the cHrriculwn and aciivitio 
developed ivithin the PIDl can be used as a base for the radio 
progmms. Specif icnlhj, this means that there is an active leanung 
focus, the i/st' of the smromidings in the deivlopment of 
appropriate activities, the imixfrtance of fxirent and comnmnity 
imvlvemait, and the fact of providing training to the caregiver 
who recognizes and sup}xv'ts the interaction of the caregiver with 
the childroi" 

Bridgiu}^ Planning and Knoxvlcdgc: The Guidebook 

The purpose and content of the guidebook changed several times 
during the pilot project. As the women in Tarija asked for more 
insights into xoh\f activities were demonstrated in the IRl programs 
and ONAMFA finetuned their own planning guidelines, it became 
clearer how the guidebcvok could bridge the gap between ONAMFA's 
training of caregivers and training plan and the activities and child 
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development information the caregivers were learning through IRI. 

Today, the ju^arido eu el Pidi guidebook describes how the actual 
activities and principles of the audio program fit into categories of 
chUd development and professional development that are emphasized 
through ONAMFA. By connecting the activities to the planning 
guidelines, the caregivers and their supervisors learn how these 
developmental activities actually take place in the pidi and they can 
better fulfill their obligations to ONAMFA. The graphs in the 
guidebook use the same categories and terms that ONAMFA uses, 
they also learn how to write up realistic plans of their own and 
document their activities in a nationally acceptable way. 

The guidebook separates these plans into two t>'pes of information: 
categories of child development and work areas for the caregiver. 
Follow-up activities are suggested in order to offer even more support 
in planning and bringing concepts down to earth. 

Charts depict the relationship of the activities in each program to the 
functional and work areas proposed by ONAMFA. 

The guidebook 
relates program 
activities to 
child 

development and 
professional 
development. 

The Master Plan: Simple and Concrete objectives 

The master plan was the conceptual and theoretical base used for the 
creation of all scripts, outlines and guidebooks. It specified individual 
program goals and hc^w to measure them, the general format of the 
programs tind characteristics of each character, and the outline of the 
content of each script. 
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The creation of the master plan began with the affirmation of the 
foliowing two points: 

1) Children and caregivers learn actively: by experimenting, playing 
and practicing. 

2) What is learned is affected by how it is learned. 

With this as the foundation and taking into account the criteria 
established by ONAMFA, a single "Master Plan" was concei\'ed. 
Each program contained four general goals: 

❖ Two goals for the training of the caregivers in techniques and 
the practice of integrated child development and the 
organization of the pidi; 

❖ Two learning goals for the children of the ages of three, four 
and five. One of these goals was based on the cognitive skills 
children develop during these years (such as spatial relations 
like up/down, forward /backward, in front of /in back of, or 
comparisons such as size or weight). The other goal 
emphasized other important messages, such as hygiene 
practices and social and emotional growth. 

According to Frida Leon, specialist in child dex'elopment and member 
of the PER team, 

"to hiwc a ) nailer phvi and a coticcptiial frmnravrk ^avc 
cousistcncif to the activities of the pw^ram." 

Furthermore, "the fact of havin^^ elaborated the viastcr phvi hi 
Bolivia made it possible to reflect this country's realitif ivith 
^reatei- accurnnf and to slart fivm the PlDl objectives and fixvn the 
ciumcteristics of the popmlation." 

It was one of the greater achie\'ements at the design le\'el of the ju^amio 
en el Pidi program, according to jiH McFarren A\'iles, National 
Ccx^rdinator of the ONAMFA's PIDI prc^gram. 

While the individual program goals within the master plan are simple 
and uneventful, the program brings the goals to life thnnigh at least 
six different play activities relating to one or several of the goals. The 
children not only do the suggested activities, but for example in the 
story in Lesson 10 they learn about a rock and a piece of paper which 
work together to send a message. Then they pretend to fly like a piece 
of paper in the wind and walk like a man holding a heavy bag full of 
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rocks. They are given the option of pretending to be other objects 
which are light and heavy. It is pointed out to the caregiver how the 
children learn cognitive concepts through activity and how she can 
set up child-to-child activities. 

Although the IRI programs are primarily auditory, the instmctions 
and activities successfully promote learning through all the senses. 
Riddles and games based on sounds are developed, for example. 
Children and caregivers are always encouraged to look and compare 
visual characteristics of size, shape and color. They search for 
information in the posters and in the pidi. In other programs the 
children touch objects to compare soft and hard or light and heavy or 
compare their actions and bodies as they move slowly, more slowly 
and extremely slowly. 

The master plan also ensured that the forty caregiver- focused goals 
were modeled. Examples include promoting self-esteem through 
encouraging statements, setting up role plays, doing fine motor tasks 
in groups, asking little girls to be helpers as often as little boys, and 
talking about fears and likes and dislikes with the children. 

Eventually, the usefulness of the master plan went beyond the 
program designers. The pilot testing of the program also showed that 
caregivers benefitted greatly if these very simple teaching goals were 
explained in the guidebook as well as on the cassette itself. 

"The orii^iiial programs of the pnlot stage did not ccvitaiu 
in format ion on the purpose of the ;^oals contemplated in the 
Master Plan. During the formative eimluation, the need to 
i}jcorporate these messages ivas obseriH'd, so that the caregivers 
icouhi have a theoni which would alloxv them to use the goals in 
other situations outside the radio program " jill McFarren 
Aviles explaiiied. 

The Script: Format, Characterization and Culture 

The detailed master plan also simplified the task of writing the 
scripts. The characters were well-established, had consistent 
mannerisms and used similar catchy expressions throughout the 
whole series. It was decided, for example, that the character of Tia 
Clara would be the only charo' ter who would address the audience. 
The team called her Tia because that is what the children call their 
caregi ers at the pidis. Her personality was intended to represent a 
caregiver slightly more experienced than the average woman 
working in the pidis. 
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And the details went further. Tia Clara always carried a boha dc 
si^rpresas or bag of surprises which was a continual source of new 
ideas during the program. She repeated terms of enthusiasm and 
reinforcement for the children such as asinic gusta (that's the way I like 
it) and the children could imitate her easily. 

The character Katy was deliberately made a little girl to provide a 
positive role model to little girls in the pidis. She was smart, light 
hearted and full of ideas for games. She had no barriers to success. 
When it comes time to pretend she is driving a truck or hammering a 
nail, Katy participates. 

Don Pancho was older, slower and wiser. He could remember stories 
of his youth and would recount them for the price of a cup of mate 
(herbal tea) and a little patience. 

Tlie character 
Katy provided 
a positive role 
model to little 
girls in the 
pidis. 



But perhaps the most deliberate character is the parrot. El Loro Ito. 
While parrots are sometimes kept as pets in Bolivia and are used in 
other children's books and stories, Ito had special significance to the 
program. Not only could he get into spaces and situations that the 
children could not, but he could repeat directions and key concepts 
without disrupting the flow\ This trait made him an extremely useful 
mascot. 

Integrating culture and setting was also introduced during the 
planning stage of the Master Plan. Bolivian nuisical instruments such 
as the zampona, the chmwv^o and the hvubo were included in the 
music and in the sound effects of the programs. Local dances like the 
iJiiqiii-auqiii, the snya and the hmyfw were used to create the 
games and activities with the children, and the Bolivian style of 
repeating a word when referring to n children's game became a 
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trademark throughout the whole program. lii<^amio en d Pidi invented 
new games like imii^fotjuiiifo (friend-friend) to intrcKliice actixities 
and relevant types of interactioi^s. 

lu Couclusion: Important issues for IRI for Early 
Child Development 

lugando cn cl Pidi has been an effective tool both qualitatively and 
quantitatively for caregiver training and for stimulating an active 
learning environment for children in pidis in BoHvia. As the program 
grows and becomes a national program and as other countries study 
it's success, several issues remain. 

Broadcasting: Radio versus Cassette Tape 

Initially, it was thought that the programs would eventually only be 
broadcast on the radio. Bolivia is a country with a history of radio 
education and has had an organized network of educational radio 
stations, Educacion Radiofonica de Bolivia (ERBOL), for twenty-seven 
years. Furthermore, IRI methodology had been successful in Bolivia in 
two prior projects: Radio health and Radio math. 

One way the 
programs 
integrated 
culture and 
setting was 
by using 
Bolivian 
musical 
instruments. 



However, due to the program's and target audiences' own 
characteristics, the team became aware of the possibilitv and assets of 
using cassettes for various reasons. First, ONAMFA provided each 
pidi with a cassette player and could assist in the deliver of cassettes 
and materials to pidis. Second, repetition is important for young 
children. Where adults may hore of an activity, young children like to 
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repecit age appropriate activities. Third, with the programs on 
cassette, a caregiver could use it according to her own needs and in 
accordance with her schedule. As few caregivers have watches or 
clocks, adhering to a radio schedule for listening or taping may not be 
the most advantageous for the pidi caregivers. Finally, as the 
experience in Tarija pointed out, cassettes can be reused in the pidi 
and for community involvement. 

Broadcasting the programs over the radiowaves is still an option in 
Bolivia, particularly if the programs can be dehvered through both 
radio and cassette. In South Africa, on the other hand, where 
regulated systems of distribution are not prevalent and reaching 
remote populations is a high priority, radio is tl^e appropriate choice. 
Supplementary materials that can be distributed through other means, 
such as inserts in newspapers or magazines, will ser\'e to support the 
radio programs. 

Initial Training: Supporting the Process 

As the programs advanced, each caregiver learned to use the cassette 
tape in her own way. Each caregiver discovered the usefulness of the 
program in response to children's reactions and when she felt herself 
learning. As the programs were developed, the caregiver herself 
becan^e aware of her importance as a nuxiel for the cliildren and ki^ew 
that the success of each program depended on her. That is, the 
caregivers learned actively within the programs without the need for 
training outside of their homes. 

Still, the utility of the programs and the usefulness of the guidebook 
multiplied with one training tor caregivers on how to interpret and 
use the IRI package. According to the Jill McFarren Aviles from the 
National ONAMFA team the inclusion of initial caregiver training 
was one of the more significant additions. 

' Before elahvatiuj;* the S(.-r/))fs for the pro^^ram, cmi\^iver fraiuins, 

not foreseen. When at lea^^t one trniiiiu^ scss/o;/ was 
eouductcd, the av\\^ivcrs had a better idea of how to use the 
materiai and the personnel elaborathii^ the pro^^rams ivas able to 
))mke the necessari/ adjustments to uuiude more specific 
instructions." 

hu'orporating more training into the system will be an important part 
of the next stage of ju^audo en el Pidi in Bolivia. 
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Focusing on Learning 

As IRI was changing to meet the needs of early child development it 
adapted some methods of IRl, threw out some traditions that didn't 
apply and capitalized on others than seemed to work. For example, 
the learning segn^ents, a staple used in many of the programs 
employing "old IRI" technology were not used as such in the jugando 
i*n cl Pidi model. The organization of the format took another form as 
segments turned into a series of acti\aties connected through a guiding 
narrative tliread. One scriptwriter would write an entire script with 
continual feedback from the broader team rather than write one 
segment. 

Iiigmido cn cl Pidi also concentrated on learning which it could 
demonstrate rather than trying to focus the interaction on a particular 
thet^ry of learning. In the programs, caregivers and children are asked 
to repeat songs and answer ob\aous questions and give tl^eir opinions 
and answer open ended questions. These interactions were chosen for 
their appropriateness for the ages involved. 

Like other IRI programs, ]iigando cn el Pidi practiced multi-channel 
learning. Children and caregivers were encouraged to learn through 
face-to-face instruction and modeling, audio-cassette or radio, visual 
aids and print. Other less obvious channels were also encouraged, 
such as other children, the natural resources available in the 
environment, and almost anything the learners could touch, smell, 
feel, leap over, crawl under, dance to or talk about. 

Teamivork 

Teamwork and collaboration were key elements in the design and 
implementation of Jui^aiido oi cl Pidi. Unlike most other development 
projects, the active participation of all the members of the team in all 
the stages of the process helped to create a group of professionals 
working on something they knew and believed in. The scriptwriter, 
artist, evaluation specialist and early child development specialists all 
observed the pidis, read the scripts and critiqued the process. 

For Jill McFnrren Aviles "to have tcwkcd hi n tnulti-disciplhum/ 
and hitcr-hi^titutional hmi is one of the factors determining the 
success of the program. More heads are better than one; this mis 
confirmed agahi and ngahi whcii people uvre leilting to listen and 
be listened to." 
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Betty Barron, an evaluation specialist from PER with experience in IRl 
methodology in math and health, maintains that: 

"Personally, at the leiK^I of the evahiation, it has been a challefii^e 
for me, I uwited to adapt the two types of formative and 
siinunative evaluations used in primarxf school math ami health, 
which proved imivssible to do. Nez\rtheless, loithin the fomative 
roaluatiou, we profited from the feedback system from the master 
plan because it lias been continuous uvrk bi/ a cohesiiv team." 

Tlie basic model 
can be used in 
other countries 
and brought to 
life with new 
stories r new 
activities and 
new characters 
in a different 
language. 

On behalf of ONAMFA, Jill Aviles adds, "continuous 
participation and supewision by national and re^^ional 
technicians and by the ONAMFA supavisi^rs ^uaranta^ that the 
l^oals outlined for the cares^ivei's and for the children in the 
)u<^ando en el Pidiare }iot lost. The i^tmls have been elahvated 
Ixised on what is projvsed for the PlDl and it is necessanj to 
reinforce thnu in and beyond the radio proj^ram." 




From the beginning the members of the group established that there 
was a need to learn redprtx-ally —each one from the others— with the 
purpose of creating something new. 

Apphjin^ the Model to Other Countries 

Iti^ando en el Pidi was created with Bolivia in mind. Already, it has 
been copied for rural areas in [Ecuador and is being rex'amped lor the 
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KwaZulu/ Natal regions of Sc^uth Africa. What has been learned can 
be adapted to other regions in different ways. The basic model and 
measurable objectives can be used and brought to life with new 
stories, new activities and new characters in a different language. 
Because the premise of the programs lies in methods of learning and 
enhancing child-caregiver interactions, varying levels of adaptation 
are possible. Other key elements to success, such as a viable 
distribution system, a useful answer to the question cassette vs. radio 
in terms of cost and sustainability in<ountry, and a way to test 
programs through formative evaluation also need to be taken into 
consideration. 

In conclusion, the pilot project m Bolivia proved that 11^ methodology 
can engage children and foster early child development skills in 
caregi\^ers. These lessons may be useful in other poc^r regions around 
the world because: 

❖ Women caregivers o^\.m have low literacv skills. Literacy 
skills of poor women caregivers all over the world are 
consistently low. But people do not need to read to learn. 
Using an audio medium such as radio or audio-cassette gives 
listeners the option of learning by making the information 
accessible. Knowledge is presented through a realistic 
learning channel which is useful and digestible. 

<♦ Acti\'e learning techniques can be modelled and practiced. It 
is not an uncommon sight to walk into a childcare facility 
anywhere in the world and see children doing almost 
nothing. IRI offers the possibility of demonstrating active 
learning techniques and showing the caregivers how to use 
simple organizational techniques, games, songs and the 
environment to create a \-ital earlv child development setting. 

<• ddiilts and childrLMi can he reached. IRI programs can be 

created for two audiences at once: caregivers and young 
children. By engaging children in age appropriate activities, 
asking the caregivers to serve as the guides and then stating 
explicitly why these activities are educational and easy to 
adapt, both audiences are involved and learning actively. It is 
at once a children's educational program and a training tcK)l 
tor the carL^gi\'ers. 

❖ l aiiv child develc)pmenl pmctice can be brought tiowii to 
raiih. Tvpical reactic)ns to leaning early cWJd development 
thcx^rv^ and practice include: the iufomatio)i /s hiv concept \ud, I 
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dou'l hiozo lunv to apply it ami I didn't know / was iioiu\i so much 
of it already. In either case, it can be diffiailt for caregivers and 
parents to bridge the gap between conceptual infomiation 
about early child development and what to actually do. IRI 
pro\ddes the opportunity to coiinect gannes and activities with 
early child development theory. Conceptual information is 
put into perspective: It is only useful when it can be learned 
and used. To be learned, it must be comnected to activities and 
experiences in the pidis. IRI helps that process along. 

Cultural and oral traditions can be reinforced. By using 
culture, radio characters and stories, IRI programs further 
invite participation and learning. Because an audio program 
can create any environment, it builds on the power of the 
imagination and the creativity of the scriptwriters and 
listeners. The children can learn through seeing, hearing, 
touching and interacting with each other and with resources 
already present in the environment. Expensive resources are 
not necessary. 

Teaching and learning can bo incorpomted into the daily 
rtnitine. The programs serve as a practical training tool for 
caregivers to use with the children during their day. It makes 
their day easier and, importantly, does not require additional 
time as learning is incorporated into the system. 

CJualiU can be controlled. Because each program can be 
tested and retested before it is finalized, quality can be 
controlled. This can be a great support to outside trainers, 
national or coramunit}' programs, and caregi\^^rs and parents. 
T\^c program can alsc^ be finetuned to be consistent with other 
guidelines, such as the training guidelines used by ONAM.FA. 

R.idio is aca^ssible to niMrK' e\'er\-ont*. Around the world, 
almost everyone owns a radio. In some places where audicv 
cassette players are available, they may be preferable, but 
nothing matches the reach of radio. 



can i^i.uticc what it preacht^. I^ither than tell caregivers 
hcnv to prcnide a devek^pmentally appropriate envirc^nment 
for children c^r write alxnit activities for children, IRl d(K^ it 
witli them. It mcKlels real activities for caregivers and children 
and points out their characteristics. Fc^r prc^pcMients of actiw^ 
learning principles, IRI prcnides the opi.X)rtunity to practice 
what it preaches. 
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